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Abstract. An open question contributed by Yu. Orlov to a recently 
published volume "Unsolved Problems in Mathematical Systems and 
Control Theory", V.D. Blondel & A. Megretski (eds), Princeton Univ. 
Press, 2004, concerns regularization of optimal control-affine problems. 
These noncoercive problems in general admit 'cheap (generalized) con- 
trols' as minimizers; it has been questioned whether and under what 
conditions infima of the regularized problems converge to the infimum 
of the original problem. Starting with a study of this question we show 
by simple functional-theoretic reasoning that it admits, in general, pos- 
itive answer. This answer does not depend on commutativity/noncom- 
mutativity of controlled vector fields. It depends instead on presence or 
absence of a Lavrentiev gap. 

We set an alternative question of measuring " singularity" of minimiz- 
ing sequences for control-affine optimal control problems by so-called 
degree of singularity. It is shown that, in the particular case of sin- 
gular linear-quadratic problems, this degree is tightly related to the 
"order of singularity" of the problem. We formulate a similar question 
for nonlinear control-afEne problem and establish partial results. Some 
conjectures and open questions are formulated. 



Keywords: optimal control-affine problem, regularization, generalized 
control, singular linear-quadratic optimal control problem, order of singu- 
larity, Lavrentiev phenomenon 



The following open question, suggested by Yu. Orlov, appeared in a 
recently published volume by V. Blondel et. al. [19J. 
Consider an optimal control problem. 



T e]0, +oo] is fixed, P denotes a symmetric definite positive matrix, / is a 
smooth vector field and G(x) = (gi(x) , g2(x) , ...,gk(x)) is an array of smooth 
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vector fields. An endpoint condition 

(3) x(T) = x T 

can be added when T < oo. 

Consider a regularization of this problem, which amounts to minimization 
of the penalized functional 

r T 

(4) Jj«))=/ x{t)' Px{t)+e\u{t)\ 2 dt^ min, 

J o 

calculated along the trajectories of ([2]). The question put by Yu. Orlov in 
|19j was whether and under what assumptions 

lim min jT (u) = inf jJ (u) . 

We show that the answer to this question is positive in almost all cases. 
Further, the result holds for every nonnegative penalization (not necessarily 
quadratic) that one may chose to regularize the functional (TjQ). 

We suggest an alternative question. In our opinion it is not the values 
of the infima which should be studied, but rather the asymptotics of the 
regularized functionals along minimizing sequences of J$. Indeed, it is quite 
general phenomenon that, for generic data lim ||tt^ m ^||r = +oo holds for 

any sequence {u^ G i oc , m S N) such that lim jliu^) = inf Jn(u). 

We trust that the minimal rate of growth of a sequence | ||u( m ) \\ L ^ , m G Nj 
that can be achieved when Jq(u^) < inf Jq(u) + ^, is an important prop- 
erty characterizing the degree of singularity of problem (d])-© or (|T|)-([2])-((3]) . 

For the particular case of singular linear-quadratic problems we are able 
to fully characterize all types of singularities that occur. For nonlinear 
control- affine case we provide partial answers. 

This paper is organized as follows. In Section [2] we answer Yu. Orlov's 
question in finite-horizon and infinite-horizon settings and introduce an ex- 
tension of this question demonstrating its interrelation with Lavrentiev phe- 
nomenon in calculus of variations and optimal control. In Section [3] we 
introduce the notion of "degree of singularity" (Definition 13. 1 H and set the 
problem of 'measuring singularity' of generalized minimizers. In Section H] 
we give a full characterization of possible values of the degree of singularity 
for singular linear-quadratic problem in finite-horizon and infinite-horizon 
settings (Theorems 14. 1( I4.2| I4.3|) . In Section [5] we introduce the case of non- 
linear control-afnne problems ([l])-©-©. The general driftless case is solved 
in Section [6l (Theorem 16 . 1 \i . In Section[7]we provide an upper estimate of the 
degree of singularity for the case, where the cost is positive state-quadratic 
and controlled vector fields gi commute: [gi,gj] = 0, Vi,j (Theorem 17. ip . In 
Section [8] we provide some evidence for existence of a better estimate for the 
commutative case and illustrate by example. The proofs of several results 
discussed in Sections HE are quite technical and are collected in Section [9l 
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A brief exposition of part of these results has appeared in jlOj . 

Partial results for generic control-afnne problems (JH)- d2J)- (EJ) with non- 
commuting inputs will be the object of a separate publication. 

We are grateful to an anonymous referee who brought to our attention 
some additional bibliographic references and whose stimulating questions 
and remarks allowed us to (hopefully) improve the presentation especially 
in what regards Section [2J 

2. Convergence of regularized functionals and Lavrentiev 

phenomenon 

In this Section we answer Yu. Orlov's question in a slightly more general 
setting. Namely, we will consider in place of ©, the functional penalized 
by ep(t,u(t)) 



(5) J £ T ( n (.))=/ x (t)'Px(t) +ep(t,u(t))dt 



where p : [0, T] x l' h [0, +oo[ is a nonnegative Borel function. We denote 
by Up the set of admissible controls for the problem (HI)-® ((H])-©-©): 

(6) Up = |u : [0, T] i— ► M fc | u is measurable, J pit, u(t)) dt < +oo| , 

provided we set 4( u ) = +oo for any u G U p for which ([2]) does not admit 
solution in the interval [0, T[. It is clear that U p = Lp[0,T], whenever 
p(t, u) = \u\ p in (|6]) with p £ [1, +oo[, as it is often the case. 

Basically, a positive answer to Yu. Orlov's question is contained in the 
following result. 

Theorem 2.1. Let U p be a class of admissible controls defined by ([6]), 
Jq(u), Jj (u) be the original cost functional ([1]) and the regularized cost 
functional ([5]), respectively. Then 

(7) lim inf Jj(n) = inf 4(u). □ 

e— >0+ u&Ap u&Ap 

Proof. Fix u*-" 1 ) £ Up, & minimizing sequence for Jq . Without loss of gener- 
ality one may think that Jq(u^) < inf J^ + l/m. Let p(t , u(t)) dt = f m . 
Then, 

inf 4 <inf JJ < 4{u^) = 

=jj(u (m) ) + ev m < mf Jq + 1/m + ev m . 
Taking e m = i^" 1 jra we conclude that 

inf 4 < inf 4 m < J L( u(m) ) < inf J o +1/m 
and hence © holds. □ 
Theorem 12.11 has the following immediate Corollary: 
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Corollary 2.2. If u £ (-) G IA P are minimizers of the regularized problems 
W-W or then 

lim Jn(u £ ) = inf J . □ 

Note that the main point of regularizing a singular problem ([I])-© or (pQ)- 
([21)- © is to obtain a similar problem possessing a minimizer in a suitable 
space of regular controls. Existence results for optimal control problems with 
control-affine dynamics typically require superlinear growth of the integrand 
in the cost functional, as \u\ — ► oo (see e.g. |4]), i.e. p(t, |u|)/|it| — > oo as 
\u\ — > oo, uniformly with respect to i S [0, 1 1 ]. Therefore, a penalty of type 
p(t,u) = \u\ 1+v (77 > 0, constant) typically guarantees existence of solution 
for the regularized problem, while a penalty of type p(t,u) = \u\ may fail 
to do it. It is also natural to assume that all the classes IA P of controls 
(see ([6])) are contained in L^[0, T]; otherwise it is hard to verify existence of 
trajectories of the control-affine system ([2]). 

An interesting extension of the original question formulated in [19] would 
be to admit not only the possibility of regularizing the functional but also 
of 'regularizing' its domain of definition. 

This would mean introducing two classes of controls U D IA P , considering 
the functional (pQ) on U while considering the regularized functionals © in 
a smaller class of 'more regular' controls lA p . Here U can be any suitable 
class of controls, not necessarily defined by an equality of type ([6]). 

Our extended question would be whether 

(8) lim inf jj(u) = inf J T (u) ? 

e— >0+ u&Ap u&A 

This question turns out to be tightly related (and in fact equivalent) to an- 
other prominent issue of the calculus of variations and optimal control - the 
Lavrentiev phenomenon (see [1] for a brief account and historical remarks). 

Recall that a functional Jq{u) defined on a class U D U p exhibits Lavren- 
tiev phenomenon or possesses IA —IA P Lavrentiev gap if 

(9) inf - 4(u)< inf 4(u). 

The following elementary result shows that validity of ([8]) is equivalent to 
nonoccurence of Lavrentiev phenomenon for Jq. 

Theorem 2.3. Equality ([8]) holds if and only if Jq does not possess U — U p 
Lavrentiev gap. □ 

Proof. Whenever we have equality in place of strict inequality in there ex- 
ists a minimizing sequence G U p such that lim jT(u^ m ') = inf jT(u). 

Now ([8]) is concluded in the same way as ([7|) has been concluded in the proof 
of the Theorem E3J 

Note that by Theorem 12. II lim inf <LT(u) = inf <Lj(u). By direct com- 

£^0+ ueUp u&Ap 

putation lim inf jT(u) > inf jT(u). Whenever the last inequality is 
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strict we immediately conclude the presence of Lavrentiev gap inf Jq(u) > 
infJ T (n). □ □ 

Thus we have completely reduced the validity of the equality © above to 
the nonoccurence of IA — IA P Lavrentiev gap for the optimal control problem 
©-© or ©-©-©. 

Lavrentiev phenomenon has been mainly studied for the classical problem 
of Calculus of Variations, Some partial results regarding occurrence of this 
phenomenon for optimal control problems are known; see (5j [21] where there 
are examples of Lavrentiev phenomenon occurring for variational problems 
with higher-order derivatives; these problems can be interpreted as Lagrange 
problems with linear dynamics. 

The Lavrentiev phenomenon is seen more as a rarity; the above cited 
results certainly involve more sophisticated cost functionals than the qua- 
dratic functional ©, though the dynamics involved are linear autonomous 
in contrast to ([2]). 

In the case of finite horizon T < +oo, nonoccurrence of L±[0, T] — [0, T] 
Lavrentiev gap in ([I])-© or (JT])- (J2J)- (J3j) can be easily proved. To see this, 
consider a minimizing sequence (n( m ) G I%[0,T\,m€ N} of the functional 
Jq(u). Recall that the input /trajectory mapping u(-) i— > x u (-) is continuous 
(on some L^[0, T]-neighborhood of each u^) with respect to L\ [0, T] metric 
of u's and L^[0, T]-metric of x u 's. Then the map u i ► Jq (u) — J*q x u Px u dt 
is continuous. As we know the functions from L*[0, T] are approximable 
in L\ -metric by functions from L^[0,T]. Hence, taking proper approxi- 
mations of the functions {u^" 1 )} we can construct for Jq(u) a minimizing 

sequence |u^ m H of functions from L^fO, T]. Therefore inf Jq(u) = 

«ez4[o,T] 

inf jT(u), which implies equality in (|8j) according to Theorem l2.31 Thus 

ueLf[0,T] 

we proved the following 

Theorem 2.4. Consider the problem ©-© ("©-©-©j with finite hori- 
zon T < +oo. Equality © holds for any classes of controls L*[Q, T] D U D 

w^4[o,t].d 

We are not aware of any results on occurrence/nonoccurrence of Lavren- 
tiev phenomenon for infinite horizon. We provide below conditions which 
can be imposed on the control system © in order to guarantee the lack of 
Lavrentiev gap for the problem ©-© with T = +oo and validity of equality 
© for a pair L k l loc , L*[0,+oo[. 

Definition 2.1. The control affine system (0|) is said to be locally stabilizable 
of order a if there exists a Lipschitzian feedback u(x), and a constant C < 
+oo such that u(Q) = and \x(t; xo)\ < C|xo| (t + l)~ a holds for every xq in 
some neighborhood of the origin. Here x(t;xo) is the trajectory of the ODE 

x = f(x) + G(x)u(x), x(Q) = xq. □ 
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Theorem 2.5. Assume the horizon to be infinite: T = +00. If the system 
|p|) is locally stabilizable of order a > |, with p G [1,2[, t/ien Jq does no£ 
/iGwe Li^oc — (£p H -Loo) Lavrentiev gap, i.e. 

inf J£°(u) = inf J °°(u). 

uei*[o,+oo[ni*,[o,+oo[ «eL^ ioc 

For p G [2, +00] £/ie equality holds provided a > ^. □ 

Proof. In the case inf Jg°(n) = +00, the theorem holds trivially. Hence 
we only need to consider the case when inf Jq°(u) < +00. 

l.ioc 

Fix e > 0. For each u G ioc let x n denote the corresponding trajec- 
tory of system ([2]). There exists u G ^i/ oc such that J °° Xu(t)' Pxu(t)dt < 

inf Jn + e < +00. Then lim f, +oc Xu(tV Pxu(r)dr = 0. Since P is pos- 

uer * iJoc ^+00 ^ ^ 

itive there must exist a sequence {tj} — ► +00 for which Xu(tj) — > 0. Since 
u 1 ^ £«(•) is a continuous mapping from L*[0, into L^[0, ij], it follows 
by density of L^[0,i,] that there exist controls Uj G L^[0, such that 

f 3 Xu 3 {t)' Px U] {t) dt < I 3 Xu{t)'Pxu{t)dt + e< inf J °°(n) + 2e; 
x U] {tj) -> 0. 

Concatenate the trajectory x Mj (•) with the trajectory 2/j(t) starting at x nj (tj) 
and driven by the feedback control u from Definition 12. 1L For every suffi- 
ciently large j G N there holds 

\y 3 {t)' P yj {t)\ < Ci|x % (^)| 2 (l + t - tj)- 2a , Vi > tj. 

This implies 

^ yj (t)'P yj (t)dt< ^_ L-ix^c^oi 2 . 

Since the feedback control ■u(x) is Lipschitzian and u(0) = 0, then |it(y,-(t))| < 
C2 (*) I < Cs|x Uj . + i — tj)~ a , and hence for some M < +00, 
J t +0 ° |tt(yj(t))| p (it < M, holds for all sufficiently large j G N. This proves 
that the control, 

Uj(t) if t < tj] 
uiVjit)) if t > tj, 

is of class Lp[0, +oo[nL^ o [0, +oo[. Evaluating the functional Jo along the 
corresponding concatenated trajectory £&.(•) we conclude that 



Uj(t) 



C 

J {uj)< inf Jo + 2e + —^—\x U] {t j )\ 2 . 

1-toc 
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Choosing j sufficiently large we thus construct a control u £ (-) € Lp[0,+oo[ 
for which 

Jo( u e) < ffif Jo + 3e. 

Taking e — > we arrive to a minimizing sequence of p-integrable controls. 
The proof is completed by application of Theorem 12.11 □ 



The following corollary follows immediately from Theorems 12.31 and 12.51 

Corollary 2.6. Assume the horizon to be infinite: T = +oo. If the system 
(0|) is locally stabilizable of order a > -, with p € [1, 2[, then 

lim inf (j^(u) + e\\u\\ p ThJn , )= inf J °°(u). 

For p G [2,+oo[ i/ie equality holds provided a > ^. □ 

Note that the convergence issue for regularized functionals is settled by 
elementary functional-theoretic arguments and the answer does not depend 
on commutativity assumptions for the controlled vector fields and other 
issues typically involved in the study of generalized controls. We would like 
to formulate now a different problem related to the system ([2]), which will 
be central point of our contribution. 

3. Degree of singularity. Problem setting 

In what follows we consider our optimal control problem with finite or 
infinite horizon. 

Due to lack of coercivity, "classical" minimizers for ((TJ)-([2j)-([3j) do not, 
in general, exist. It is known that for generic boundary conditions, mini- 
mizing sequences of classical controls usually converge to some 'generalized 
controls' which may contain impulses or more complex singularities. For 
such problems quasioptimal (e-minimizing) controls u £ are known to exhibit 
high-gain highly-oscillatory behavior. It is expected lim ||?/||r = +oo to 

£^0+ 2 

hold for any minimizing sequence {u 6 }. Still the asymptotics of growth of 
1 1 u£ 1 1 L 2 var i es from problem to problem and therefore this asymptotics can 
be used for measuring the degree of singularity of the problem. This is also a 
problem of practical importance, because suboptimal controls are harder to 
realize in practice when "good" approximations of inf Jq require 'too high' 
gain and 'too fast' oscillation. 

In order to address this question, we introduce the following measure of 
"singular behavior" of a problem (HI)-©-©. 

Definition 3.1. In the finite horizon case the degree of singularity of the 
problem (EP"®-® is 

inf {in \\u\\ L : Jq(u) < inf + e, \x u (T) — xt\ < e} 

o~t = hm sup ■ . 

£^o+ In - 
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In the infinite horizon case the degree of singularity of the problem £?P-£^ 
is 

inf {ln|M| L : J °°(u) < inf J °° + e\ 

(Too = lim sup 5 . □ 

£ ^0+ In - 

Our main goal from now on will be computation of degree of singularity 
for various optimal control- affine problems. In the next Section we provide 
a complete analysis for singular linear quadratic problems. 



4. Singular linear-quadratic case 

In this section we discuss the relationship between the degree of singu- 
larity o~t and the structure of generalized minimizers in the singular linear- 
quadratic case. We believe this relation provides a compelling evidence for 
the usefulness of degree of singularity for measuring singular behavior of 
minimizing sequences. 

In [9], a definition of order of singularity for LQ problem has been in- 
troduced and it was shown that singular linear-quadratic problems can be 
classified according to it. This order of singularity is an integer r < n, n 
being the dimension of the state space. If inf Jn(u) > — oo, then a problem 

u 

of order r admits a generalized minimizer in the Sobolev space H- r . 

We will show that the degree of singularity o~t from Definition 13.11 is 
tightly related to the order of singularity of a problem. For (singular) LQ 
problems with state-quadratic integrand x'Px and P > it is shown that 
o~t = 2> while order of singularity equals 1. For an LQ problem, with more 
general functional (jlip . order of singularity r and generic boundary data, 
o~t = r — ^. When nongeneric boundary conditions are imposed, one can 
show that o~t admits values from a finite set. These values correspond to a 
stratification of the space of boundary data, which is related to results in 
03], [HI, [22] and [9]. 

The content of Subsections 14. II to 14.41 below is essentially a brief sketch of 
the results contained in [9], which are essential for the computation of cry. 
Subsection 14.51 contains an important technical result (Proposition I4.10p 
regarding approximation of distributions from Sobolev space H_ r . This 
result is applied in Subsection 14.61 to computation of the values of degree of 
singularity gt- 

4.1. Assumptions. Along this Section the controlled dynamics ([2]) is linear 
time-invariant: 

(10) x = Ax + Bu, x(0) = x . 

The end-point condition is ([3]). The cost functional, we consider, will be 
more general than ([T]): 

(11) Jq{u)= I x' u Px u + 2uQx u + u'Rudr, 

Jo 
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where R is a symmetric nonnegative matrix. If R is positive definite, then 
there exists analytic minimizing control for this problem (at least for suffi- 
ciently small T) and hence the degree of singularity <tt = 0. Therefore the 
case of interest is the singular one, where R possesses a nontrivial kernel. 
We assume the following to hold. 

Assumption 4.1. Let the matrices A, B, P, Q, R in (fiflj). 07] ) be such 
that for xo = xt = and each T e]0, +oo[, there exists a subspace , of 
finite codimension in L|[0,T], such that Jq > on \ {0} (the subspace 
and its codimension may depend onT). □ 

Assumption 14. II may look not very natural, but as we will now explain, it 
is closely related to finiteness of inf <Lj. 

If there exist T e]0, +oo[ and an infinite-dimensional subspace, S~ C 
Lo[0, T] such that Jq(u) < in 5~\{0}, then one can prove that inf Jq(u) = 

u 

— oo holds for every T > and any boundary conditions. Thus finiteness of 
inf requires that for each T e]0, +oo[ there exist some subspace of finite 
codimension in L\ [0, T] where Jq is non-negative. In this case, the only way 
in which Assumption 14.11 can fail is when the quadratic form u i— ► Jq(u) has 
infinite-dimensional kernel. In [9] it is shown how this kernel can be "factored 
out". Naturally, Assumption 14.11 will hold after such a factorization. 

Resuming, we may think of Assumption 14.11 as of a version of the more 
intuitive 

Assumption 4.2. inf Jq (u) > —oc holds for each boundary data (xq,xt) 
(for each initial data xq, when T = +oo). □ 

Assumptions 14. 1 1 and 14.21 are closely related but not equivalent. Using the 
first one is more convenient from the technical viewpoint. A complete study 
of problems (fT0|) -([3j)- (fTT]) which satisfy inf Jq(u) > — oo can be found in |9j. 

u 

Therein it is shown how Assumption 14.11 can be checked using only linear 
algebra computations. 

Note that, in the finite-horizon case neither P nor the quadratic form 
(x, u) i — > x'Px + 2u'Qx + u'Ru need to be nonnegative for inf Jj(n) > — oo 

u 

to hold. In the infinite-horizon case we will require this latter nonnegativity. 

4.2. Desingularization of LQ problems. Provided Assumption HTTI holds. 
a singular linear-quadratic problem (|10p -([3|)- (|lip can be reduced to a regular 
problem, i.e. to an LQ problem with quadratic cost, which is strictly convex 
with respect to control. This is done by the following multistep procedure 
(for a detailed account of a more general procedure without Assumption 14. 11 
see [9]). 

Let 4> '■ l— * be the primitivization: 

4>u(t) = / u(t) dr, Vu G L 2 j c- 
Jo 
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By choosing a suitable coordinate system in the space of control variables, 
we may assume without loss of generality that the nonnegative matrix R in 

([IT]) is of the form R = ( jj V where i? ,o G M fc ° xfc( \ i? ,o > 0. We 

consider the corresponding splitting of the vectors u = (uq,ui) G ffi fc , uq G 
R fc ° and of the matrices 

pnxk tj r- iranxfto D ( Qo,0 



B = (B„,o,£o,i) G M" xfc , 5 ,o G M nxfc0 , Q = I ^ 1 G M fex ", Q ,o G 
Let us introduce the operator 7 : loc 1— > -L^ Zoc 

7u = hi + o (Qo,o^o,i - -6 , (3o,i) <Mi> <Mi) • 

The following Proposition represents the trajectory x xo ^ u and the value of 
the functional Jq{u) via solution of an LQ problem, which is 'less singular'. 
Due to it the representation below is called desingularization procedure. 

Proposition 4.1 ([9]). For every xq G W 1 , u G L% [0, T], there holds: 
(t) + B ,iM (*) , 

JO 

+ / u[ (Q 0>1 B 0>1 - B' Q X Q' Q x ) (fwi dr+ 
Jo 

+ 2<jm 1 (T)' Qo,i4o, 7 « ( T ) + ^1 ( T )' Qo^Bo^ux (T) , 
where x\ Q v denotes the trajectory of the system 

x = Ax + .Biu, x (0) = Xo, 

B\ = (B 0t Q, Bi t i) ; 

Bi,i = [A — -60,0^0,0^0,0 J -60,1 + -60,0-^0,0-^0,0^0,1; 



Q 



tfo,o 

Qi,i = B' Q1 (^P — QofiRo^Qofi) — Qo,i (A — -60,0-^0,0*30,0 
I R o,o \ 



For Assumption \4- 1\ to hold, there must be 

(12) Qo,i-6o,i - B' 01 Q 01 = 

and R x > 0.D 
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If Assumption 14.11 holds for the 5-ple (A,B,P,Q,R), then it also will 
hold for the 5-ple (A, Bi,P,Qi,Ri), which corresponds to the desingularized 
problem. The quadratic form (x, u) t— > x'Px + 2u'Qx + u'Ru is nonnegative 
if and only if the quadratic form (x,u) t— > x'Px + 2u'Q\x + u'R\u is. If 
i?i has a nontrivial kernel, then we can repeat the procedure obtaining a 
sequence (A, R>i, P, Qi,Ri), i = 1, 2, .... The following Proposition states that 
this sequence must be finite. 

Proposition 4.2. If Assumption \4-l\ holds, then there exists an integer 
r < n such that R r > O.D 

In [9] the integer r is called order of singularity of the problem (|10p- 

Without loss of generality, we may assume that the coordinates of the 
space of control variables are such that the matrices (P>i,Qi, R), obtained 
at each desingularization step, have block structure 

Ri = diag (i?o,o, R\,i, • • • , Ri,i, 0) , 

Bi = {Bofl Bi t i • • • Bi t i -Bi,;+i • • • Bi >r ) , 

Q'i = {Qo,0 Ql,l ' ' ' Q'i,i Q'i,i+1 ' ' ' Qi,r) • 

Let us introduce operator 7 r = (7 r ,o>7r,l> — 7r,r) : -^2«oc l— * as follows 

7r ,^= fiui + R^ J2 (Qi^i-Z'aQ'ii)^ 1 ^ 

i = 0,l,..,(r-l); 

(13) 7r,r"U = </> r U r . 

This operator is used in the next Subsection to introduce a suitable topology 
in the space of generalized controls. 

Applying Proposition 14. II consequently r times, we arrive to the following 
corollary. 

Proposition 4.3. The trajectory x XQtU can be represented as 

(14) x x ,u = x xo ,"/ r u ^ Bi,j<fr + Uj, 

0<i<j<r 

where x r X0 ^ rU denotes the trajectory of the system 



(15) 



x = Ax + B r j r u, x(0) = xq. 
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If Assumption \4-l\ holds and T < +00, then the functional Jq can be 
represented as 



4(u) 



I X ^ r ll 

JO 

+2 f +1 u j (T) , Q i , j xl u (T) + 

0<i<j<r 




i+1 



0<i<j<r 



where R r > 0. □ 



It turns out that the nonintegral terms in the latter representation of Jq 
depend only on T, xo and xt, and hence 

(16) Jq(u) = / x r 'Px r +2j r u'Q r x r +-f r u'R r j r udt + 
Jo 

+Cj (x ,x T ) , 

where Cj (xq,xt) is quadratic with respect to (xq,xt)- 

Remark 4.1. Recall that in the infinite-time horizon version of the problem 
we assume nonnegativeness of the quadratic form (x, u) 1— ► x'Px + 2u'Qx + 
u'Ru. In this case the nonintegral terms vanish and the functional takes 
form 

POO 

J 0°( u ) = / x j r u' Px j r u + 2 lrUQ r X r lrU + J r u'RrJ r udt. 
JO 

4.3. Weak norms, generalized controls and trajectories. Consider 
the following norms in the space of inputs L 2 [0,T] and in the space of 
trajectories L 2 [0, T] (we embed absolutely continuous trajectories in L 2 ): 

Ml -»-■-» — ^ 



Hr 



[o,T] — ll7r«[lz,fc[o,T] ' M G L 2 [0,T]; 



W u h r [o,T] = ll7r«|lifc[o,^ + E \<P l Uj(T)\ , u £ L 2 [0,T}- 

X<i<j<r 

IMItf^lO.T] = II'^IIl^O.T] J x e L 2 [0,T]. 

Fix T G]0,+oo[ and let 

• ZY 7t .[ 0) t] be the topological completion of L 2 [0, T] with respect to 
\\'W-y r [0,T]'i 

• [0,3*1 be the topological completion of LgfO,! 1 ] with respect to 

IHItvIo.t]! 

• _ff™ r [0, T] be the topological completion of L 2 [0, T] with respect to 

\\'\\H" r {0,T]- 

The following holds true (see [9]) 
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Proposition 4.4. The input-to-trajectory map u \— ► x XlhU , is uniformly con- 
tinuous with respect to the norm ||-|| 7r [o t] of inputs and the norm \\-\\gn [q t] 

of trajectories. The functional Jq(u) is locally uniformly continuous in the 
norm ||-||^ j 0T ] of inputs. □ 

As a corollary we obtain. 

Proposition 4.5. The input-to-trajectory map u t— > x XOtU admits a unique 
continuous extension with domain Z^ 7r p,T] an d range in H\ r _^ [0, T\, while 
the functional Jq(u) admits a unique continuous extension onto U~ [o,t]- 
These extensions can be defined by equalities U6\) and respectively. □ 

We denote Z^ 7r [o,+oo[ the topological completion of l\ loc with respect to 
convergence in all the norms |HI 7r [oT]' (with r fixed like in Proposition 
14.21 and T ranging in ]0, +oo[). Similarly, /f™ r [0,+oo[ is the topological 
completion of i^Zoc w hh respect to convergence in all the norms ||-|| H n j t] 
(T < +00, r fixed). 

Proposition 4.6. The map u 1 — > x X q U admits a unique continuous extension 
onto ^ 7r [o.+oo[- If ^e quadratic form (x,u) 1— > x'Px + 2u'Qx + u'Ru is 
nonnegative, then the map u 1— > Jq°°(u) admits a unique extension onto 

^7 r [0,+oo[- Q 

Note that any function v £ l\ loc defines uniquely a generalized control 
u G U- r [ ^] such that 7 r u = v and (f> l Uj(T) = Vi t j, 1 < i < j < r (Vij fixed 
constant vectors of suitable dimensions) ; the metric in the space u 6 U- v r 0> T] 
is induced by L2-metric in the space of v = ^y r u. 

4.4. Desingularized LQ problems and generalized solutions. Ac- 
cording to Proposition 14.31 the problem pop -([3l)- (lll|) can be transformed 
into the following regular LQ problem with the control v = j r u: 

(17) Jred( v ) = / x'Px + 2v'Q r x + v R r v dt — > min, 

Jo 

(18) x = Ax + B r v, ueLf[0,T], x(0) = x , 

(19) x(T) ex T + span < i < j < r} , 

with the endpoint condition (|19p being dropped in case T = +00. Since 
R r > 0, classical existence theory applies to (fT7|) - (fT8]) - (fT9|) . 

Definition 4.1. A functional 9 defined in a normed space (X, \\ ■ ||) is said 
to be quadratically coercive if there are constants a £ R, b > such that 

0(C) >a + bU\\ 2 , V£eX. □ 

Due to the relationship v = j r u, between the new and the original con- 
trols, the following results hold true for (fTO -(f3l)- (fTTT) . 



Proposition 4.7. Let Assumption\4. 1\ hold. Then: 
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i) for each sufficiently small T > 0, the functional Jq(u) is quadrati- 
cally coercive on {u 6 Uy ^x] : ftujiT) =0, 1 < i < j < r}; 

ii) /or any T > the functional Jq(u) is quadratically coercive on a 
subspace of finite codimension in Uj ^x] ; 

iii) If T = +oo, and the quadratic form u \— > x'Px + 2u'Qx + u'ifrx is 
nonnegative, then the functional Jq°(u) is quadratically coercive on 

w Tr [o,+oo[- n 

Using Proposition 14.71 classical existence theory and the relationship v = 
"frU we obtain the following: 

Proposition 4.8. Let Assumption \4. 1\ hold. 

For the finite-horizon case: there exists Tq g]0,+oo] such that 

i) For each T e]0,To[ ; and every xt accessible from xq, problem U0\) - 

admits a unique generalized solution, (u,x) £ [ r] x 

ii) For any T > Tq, and every xt accessible from xq, inf jT = — oo 

u 

holds; 

For the infinite-horizon case: 

iii) // the quadratic form (x, u) i— ► x'Px + 2u'Qx + u'Ru is nonnegative 
and system [ffl\) is feedback stabilizable, then problem (TCfy -[Tl\ ) ad- 
mits a unique generalized solution, (u, x) G Z^ 7r [o i + o[ x ^-(r-i)[0) +oo[. □ 

For the proofs of these results, see [9]. We will now briefly discuss the 
structure of generalized optimal solutions. 

For regular linear-quadratic problems any optimal control v*(-) satisfies 
the Pontryagin maximum principle and is analytic. From the desingulariza- 
tion procedure (Proposition I4.3[) there follows that the corresponding opti- 
mal generalized control for the original singular LQ problem (|10p -(j3])- (|lip 
satisfies the relationship j r u* = v* , with 7 r defined by (|13p . Hence it is a 
sum of an analytic function and a distribution of order < r. This distribution 
is supported at the points t = and t = T. 

The corresponding generalized optimal trajectory is analytic on ]0, T[ and 
may happen to be discontinuous at points t = and t = T. The generalized 
trajectory "jumps" at t = from x(0) = xq to the point 

x(0 + ) = x + Yl B ij cf > i+1 u 1 (0 + ). 

0<i<j<r 

For t g]0,T[ it coincides with the analytic curve 

<t) = x r XOtJrU (t) + Yl B itj <p i+1 Uj (t), 

0<i<j<r 
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where x r xo „ u is the trajectory of (fl~5j) driven by the analytic control 7 r u. 
The generalized trajectory terminates with a "jump" from the point 

x{T~) = x r lTU {T)+ Y, B i,i<f> i+ S(T-) 

0<i<j<r 

to the point 

x(T) = x r lrU (T) + Yl B l ^ +1 u J {T)=x T 

0<i<j<r 

(the vectors (f) t u(0 + ) and (j) l u{T~) are well defined for all i > 0). 

Assumption 14.11 guarantees that for any jump x(t^) — x(t^ ) belonging to 
span{l?jj, < i < j < r} there exists a unique distribution A £ ^/ 7r [o,+oo[ 
supported at {to}, such that 

x(4)-x(t Q )= Y l^j""'^r 
0<i<j<r 

The following result states an important property of the optimal synthesis for 
problem ([10]) -CD])-© (see [13], [14] and a result in [THJ Ch.6], which claims 
a minimizing control to be " generically" a sum of a continuous control with 
impulses of different orders located at the initial and the final point of the 
time interval). 

Proposition 4.9. Let Assumption ^. 1\ hold and the infimum of the problem 
f70j) -f3])-(f77] ) be finite. Consider the subspace B r = span{B{j, < i < j < r}. 
For all 

(20) Xq <E Xo + B r , XT G XT + B ri 

the problem with boundary conditions x(0) = xq, x(T) = xt admits a gen- 
eralized optimal solution (control and trajectory). For each boundary data 
from the sets i20\) there exists a generalized optimal solution coinciding in 
the interval ]0, T[ with the analytic arc of the solution for the data (xq, xt)- O 

Suppose Assumption 14. 1 1 to hold. Let m = rank [B, AB, A n ~^B) , and 
let p = dimspan{5jj, < % < j < r}. Fix T £ ]0,+oo[ and let X C M. 2n , 
denote the set of pairs (xo, xt) for which the problem (fT0|) - ([TT|) -(f3|) possesses 
classical optimal solution, (n, x u ) G L^O,! 1 ] x ^4C7 n [0,T]. Propositions 14.81 
and 14.91 imply that, if T > is sufficiently small, then X \s a, linear subspace 
of dimension n + m — 2p. Further, existence and uniqueness of generalized 
optimal solutions implies that any pair (xo,xt) £ M. 2n , such that xt is 
reachable from xo, admits a unique decomposition 

(21) (x ,X T )= (x ,X T )+ E ( ) a i,j+ E ( R ) 0i,j, 

0<i<j<r \ u J 0<i<j<r V % >j J 
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with (xq,xt) £ X, and aij, fyj being vectors of appropriate dimensions. 
The discontinuities of the generalized optimal trajectories are computed as 

x(0 + ) -X = ^ B i,J a i,3> 
0<i<j<r 

x T -x(T~)= B i,j(3i,j- 

0<i<j<r 

4.5. Approximation of distributions. The following Proposition gives 
the asymptotics of approximations of some important distributions by square- 
integrable functions. 

Proposition 4.10. Consider a m th -order distribution of the form 

m-2 
i=0 

where at E R, i = 0, 1, m — 2, and 6® denotes the i th generalized deriva- 
tive of Dirac's " delta function" . 

For every integer p > m there holds 

Hm mf{log|hl| £2[ o, T1 :|l«-fi| g _ p[0 , T1 <>?} = 2m-1 
v ^0+ l°S^ 2(p-m)+l ' 

The rather technical proof of Proposition 14.101 can be found in Subsec- 
tion ETJ 



4.6. Degree of singularity of LQ problems. For the finite horizon case 
(T < +oo) the following result holds 

Theorem 4.1. Consider the problem U0\) -^)-li 1 Suppose Assumption 
\4-l\ holds and let (xo,xt), (xo,xt)> ctij, Pij be as in [2l\). 

(1) If ctij = 0, /3ij = 0, < i < j < r, and the optimal control is 
not identically zero, then ctt = 0; if the optimal control is zero then 
a T = -co; 

(2) If either aiij ^ or fyj ^ for some then 

(22) a T = max / + */ 2 . □ 

< i < j < r, 2 U - V ~ 1 
(aij + or ± 0) 

Theorem l4.lt together with the decomposition (|2ip results in the following 
description of the geometry of singularity of LQ problems. 

Theorem 4.2. The space W 1 x R n of boundary data admits a stratification 
into linear subspaces. The directing linear subspaces of strata are spanned 
by the columns of the matrices 

Bin \ n .. 

flyj' 0<t< 3 <r, 
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with B{j defined in Subsection \4-S\ Different strata correspond to differ- 
ent distributional components of optimal generalized controls. For generic 
boundary data (the largest stratum) optimal generalized controls contain dis- 
tributional components of the form #( r-1 ) ; the degree of singularity equals 
r — 1/2. When passing to the strata of smaller dimensions the order of 
singularity o~t decreases, admitting values from the list 

i + 1/2 



2(j -0-1 



< i < j < r, > . □ 



The infinite horizon case (T = +oo) is analogous to the finite horizon 
case; one just has to deal with stratification of the space of initial data. 

Let Xq C M n , denote the set of initial points xq for which problem (|10p - 
(jlip has a classical optimal solution, (u,x u ) E L\ [0, +oo[x^4C" 1 [0, +oo[. If 
the quadratic form (x, u) >— > x' Px + 2u' Qx + u' Ru is nonnegative and system 
(|10p is feedback stabilizable, then Theorem 14. 91 guarantees that Xq is a linear 
subspace of dimension n—p. Further, existence and uniqueness of generalized 
optimal solutions implies that any initial point xq E W 1 admits a unique 
decomposition 

0<i<j<r 

with xq E Xq, and on j being vectors of appropriate dimensions. The dis- 
continuities of the generalized optimal trajectories are 

x(0 + )-x = B i,j a i,j- 

0<i<j<r 

Thus we have for the infinite horizon case the following analogous of Theo- 
rem Hj] 

Theorem 4.3. Consider the problem ilO\) - (Tl}) . with T = +oo. Let As- 
sumption hold, the quadratic form (x,u) x'Px + 2u'Qx + u'Ru be 
nonnegative and system U0\) be stabilizable by linear feedback. Then 

(1) If ocij = 0, < i < j < r, and the optimal control is nonzero, then 
Coo = 0; (Too = — oo, if the optimal control is zero; 

(2) If otij / for some (i,j), then 

o-oo = max — -. □ 

< i < j < r 2 U - l ) ~ v 



Remark 4.2. Since the system \10\) is linear, it follows that it is stabilizable 
if and only if it is stabilizable by a linear feedback. Therefore it is stabilizable 
if and only if it is stabilizable of order 1 in the sense of Definition \2.1\ 



Proof of Theorem 14.11 Notice that a^j = 0, (3ij = for all such 
that < i < j < r if and only if the optimal control is an analytic function 
in [0, T], Thus, assertion (1) follows immediately. 
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Otherwise the optimal control is the sum of an analytic function with a 
distribution concentrated at points 0, T. We will first prove that or can not 
exceed the value (|22j) . 

For each j £ {1, ...,r} let pj = maxji : a^j ^ or /3y 7^ 0}. Let 7} = 
(«o, iii, u r ) denote the generalized optimal control. Since (f2~Tj) holds, then 
by equality (fl~4j) Uj contains a distributional component of order Pj + 1, sup- 
ported at {0,T}. Proposition 14. 101 guarantees the existence of {u r>TI , rj > 0} 
such that 

K i?? -n r )|| i2[0iT] =0(77), IKJ^o.r] = O ^~3P^j=r) . 

Suppose that for some j > 1 we can chose {(uj + i tV ,Uj + 2 tV ,u riV ) , 77 > 0} 
such that 

r 

X] \hr,q(u n -u)\\ L2[0:T] =0(rj), 

r / 2 P(? + 1 \ 

V llu II -Q n" max,> W 

/ , II u 9^Hl 2 [o,t] - 17 I v J- 

g=i+i v y 

Since 

j'<i<Z<r 

are square-integrable and all distributional components of u are supported 
at {0, T}, then for some constants V®, V? ', i = 1, 2, —,Pj, and some square- 
integrable function, it; there holds 

O + E i^oAl ~ />•;.//./) (t) = 

j'<i<Z<r 

=«(*)+£ w + (* - T )) • 

Proposition 14.101 guarantees that one can chose square integrable functions 
Ai iTj such that 

ll^-A^I^.^ =0(77), 
II A ^IIl 2[ o,t] = (V , i = 1,2, 

Let 

= ^+ E fa° A ^ (*) + ^ Ta ^ (* - T )) - 

8=1 

j'<i<i<r 
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This choice of Uj iTj guarantees \\"f r ,j {u n — fi)[|x 2 [0T] = ^ ( r ?) anc ^ 



+ J2{V^i,r,(t) + VTA i>v (t-T)) 



i=l 



E 



2p,-l 



IV 



,i=j+l 



i=j+l 



This proves existence of a family of square-integrable controls, {u v , n > 0} 
such that 

2p g + l 

S -u\\ 7r =0(rj), ||^|| L2[0jT] = Olq 



max 1 <„< r — . r — - 

2(<J- Pg )-1 



and therefore, 



i+i/2 

ut < max — . 

< % < j < r, 2 (j - - 1 

(oij / or fa + 0) 
In order to prove the inverse inequality, pick the greatest value m of those 



j for which 
controls 

such that 



2 Pj -l 



2(J-Pi)+1 ~~ I™' 2(»-Pi)+l 

{^r, = (v 0iV ,v 1>v , ... , u nJ7 ) , rj > 0} 



ggj-l 



Suppose there exists a family of 



2pm -1 



[|tt — «jj|| 7 = 0(??); hm + [|u[| i2 ^ 2 ( m -pm)+! = 0. 
By Proposition 14. 101 there exist constants C\,Ci such that 

_ 2p m — 1 
C 1? y 2(m-p m ) + l < 



< 



i+ R m , m {Qm,mBij B mm Q i j)(f) 

m<i<j<r 

which is a contradiction. 



■m+l 



L 2 



<C2W La , 



5. Singularity of nonlinear control-affine problems 

While we have managed to provide exhaustive analysis of the degree 
of singularity for singular linear quadratic problems, similar questions for 
control-affine nonlinear problem (HI)-© -([3]) still need to be answered. 

Question. Is the set of possible values of degree of singularity ot for control 
affine problems (QP-([Di-(Ep finite? Is the value of o~t semiinteger for generic 
boundary data? Does this set of numbers correspond to a (local) stratification 
of the state space ? □ 



There is research activity related to this question. 
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It is important to correlate the degree of singularity ot with the order of 
singularity introduced by Kelley, Kopp and Moyer in [15] ) (see also [16] ) for 
singular extremals of optimal control problems. 

Another recent study carried out in the context of sub-Riemannian ge- 
ometry and motion planning, invokes concepts of entropy and complexity 
(see [121 [8]). The connection of these notions on one side with the degree of 
singularity on the other side is yet to be clarified. 

In the following Sections we study the degree of singularity for generalized 
minimizers of control-affine problem (pQ)-(j2|)-([3|) with positive state- quadratic 
cost. 

Apparently commutativity/noncommutativity of controlled vector fields 
affects the value of order of singularity ot a great deal. The connection 
between the commutativity/noncommutativity and generalized minimizers 
is an established fact [191 ISHl El [3]. Yet it is not well understood, how 
the Lie structure is revealed in the properties of generalized minimizers. 
The commutativity assumption is not immediately apparent in the linear- 
quadratic case, but in fact, (fl~2"]) is the commutativity condition for the class 
of singular problems discussed in the previous Section. 

Here is the list of results on nonlinear control-affine problems, which ap- 
pear in the following sections. 

We start with control-linear (=driftless) case and prove (Section [6|) that 
for generic boundary data degree of singularity equals \ independently of 
commutativity/noncommutativity of inputs. 

In Section [7] we establish an upper estimate ot < 3/2 for the degree of 
singularity of control-affine problems ([I])-©-© with commuting controlled 
vector fields and positive state-quadratic cost (Theorem I7.ip . In Subsec- 
tions I7.1M7.4I we provide a sketch of the proof of this result. The proof of 
the main result in Subsection 17.31 can be found in [llj. A full proof for the 
material in Subsection 17.41 can be found in Subsection 19.31 below. 

In Section [8] we provide some evidence which allows us to conjecture that 
the degree of singularity in the commutative case should be < 1. An example 
is examined. 

6. Non-commutative driftless case: general result 

It turns out that the non-commutative driftless case 

i-t 

(«(•)) = / x{t)'Px{t)dt -» min, P > 0, 
Jo 

r 

(23) x = ^J^Uf, x(0) = x , x(T) = x T , 

3=1 

is rather simple. In this case for generic boundary data the value of the 
order of singularity equals ot = 1/2 , i.e. it does not depend on the Lie 
structure of the system of vector fields {g , . . . ,g r }. 
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Theorem 6.1. Let A XQ be the attainable set (in the driftless case the orbit) 
of the control system jl23\) . Let xt G A Xo and 

(24) a = mi{x'Px\ x G A xo }. 
Then: 

i) the infimum inf Jq = aT; 

ii) the degree of singularity or > | unless x' Pxq = x' t Pxt = a; 

iii) if the infimum \2J$ is attained then the degree of singularity aT < 

A detailed proof can be found in Subsection 19.21 Here is a brief idea for 
the case when the system {g 1 , . . . , g r } has complete Lie rank. Then, roughly 
speaking, generalized optimal trajectory consists of three 'pieces': an initial 
'jump', which brings it to the origin 0, a constant piece x(t) =0,t G]0, T[, 
and a final 'jump' to the end point x(T) = xt- Evidently inf J F = and a 
simple homogeneity based argument shows that ot < 1/2. 

To prove that in fact or = 1/2 whenever xq ^ or xt ^ 0, assume that 
xq / (the case xt / is analogous), fix e > and take a control u £ , such 
that 

i-t 

(25) 4(ue)= / x' Us (t)Px Us (t)dt <inf 4 + e = e. 

Jo 

Consider the set G iR n | x'Px < ^XqPxo}; let /O be the distance from xq 
to this set. Since x'Px is positive definite, one concludes from the inequality 
(f25|) . that there exists t £ < x , 2 p xo such that x Ue (t £ )* Px Ue (t £ ) < (l/2)x' Px . 

Then, by Cauchy-Schwarz inequality, the control needed to achieve x Us (t £ ) 
from xq in time t £ , must satisfy the estimate ||w e ||!r or ] > pt £ x > Ce^ 1 , for 
some C > 0. 

7. Degree of singularity for control-affine systems: 

commuting inputs 

In this section we discuss the degree of singularity of optimal control 
problems of type (H}-©-© with T < +oo. 

In what follows we denote by e tF the flow of the smooth field F; for each 
point xq G W 1 the curve t i— > e tF xq is the unique solution of the differential 
equation 

X = F(x), x(0) = Xq. 

For fixed t the map x i— > e tF x is a local diffeomorphism in a neighborhood 
of any point xq such that e tF xq exists. 

For every (local) diffeomorphism P : W 1 ^ M. n , and any vector field F, 
we denote by AdPF the (local) field defined as 

AdPF(x) = {DP{x))- 1 F{P{x)), 

where DP(x) denotes the Jacobian matrix of P evaluated at the point x. 
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We keep the notation introduced in Section HI according to which <f> de- 
notes primitivization (i.e., cfm(t) = J* u (r) dr, Vu G L\^ oc ). 
We introduce several assumptions. 

Assumption 7.1. T/ie fields f , gi, i = 1, are complete. The controlled 
vector fields gi span k-dimensional involutive distribution; for simplicity we 
assume that [gi,gj] = holds for all i,j. □ 

The following three assumptions regard conditions on the growth of /, g % 
and of their derivatives. 

Assumption 7.2. For any compact set K C W 1 

lim |e Gi; x| = +oo, 

|u|^+oo 

uniformly with respect to x £ K . □ 
Assumption 7.3. For any compact set K C W 1 

-§- ((e Gv x)'P(e Gv x)) 

lim — — ^ ^ = °> 

|d|^+oo le^xl 

uniformly with respect to x £ K . O 

Assumption 7.4. For each compact set K C W 1 there exists a function 
7 : [0, +oo[i— > 1R bounded below, such that: 

i) lim = +oo; 

u) \e G -x\ 2 > 7 (| (Ad [e Gv ) f) (x)\ + |£ (Ad (e Gu ) /) (x)|) , 

V(s,u) e A" x □ 

As we will see below, Assumption 17.11 allows us to use a reduction proce- 
dure analogous to the procedure employed in Section [4] for the treatment of 
singular linear-quadratic problem, while Assumptions [7^217.31 and 17.41 guar- 
antee existence of minimizers in a suitable class of generalized controls. 

The Assumptions 17.31 and 17.41 are somehow less explicitly formulated. In 
the two following remarks we formulate more particular growth conditions 
onto vector fields / and g l and their flows which guarantee fulfillment of the 
two Assumptions. 

Remark 7.1. Assume that the drift vector field satisfies the growth condi- 
tion 



\f(y)\<H\y\)- 
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For the flow e generated by the controlled vector fields, we require 

o I 



(26) 
(27) 

(28) 



\De Gv x\ 



\D 2 e Gv x 




as \v\ — > oo, uniformly for x belonging to any fixed compact K. 

A typical choice of ip which guarantees completeness of f would be 

^(|y|) =k(l + \y\). 

In this case %W\) and (2~7\ ) take the form 



De Gv x\ + 



(De^xy 1 



\e Gv x\ 



while I128\) would mean that \D 2 e Gv x\ \e Gv x\ is uniformly (with respect to 
x from a fixed compact K) upper bounded for all v. □ 

Another case we had in mind is described in the following 

Remark 7.2. In the particular case of constant vector fields gi, i = 1, 2, k 
the condition (ii) of the Assumption \ 7.J\ reads 

M 2 >i(\f(x + Gv)\ + \Df(x + Gv)\), V(x,v) eKxR k , 

i.e. |/| and \Df\ must exhibit subquadratic growth along the directions 
spanned by gi, i = 1,2, k. 



It is straightforward to check that Assumptions 7.2 and 7.3 hold if the 
fields gi, i = 1,2, ...,k are linearly independent. □ 

Our main result in the commutative case is the following. 

Theorem 7.1. // Assumptions \ 7. 1\ \ 7.2\ \ 7.3\ and \7.J\ hold for problem (QP- 
HJ-lEJj, then 

3 

o- T <- 

for T < +oo and generic boundary conditions. □ 

The rest of this Section contains sketch of the proof of Theorem 17,11 
The feature which distinguishes the proof is an unbounded set of control 
parameters. In this context some components of the proof gain (in our 
opinion) an independent interest. Among those is Theorem 17.21 on existence 
and Lipschitzian regularity of relaxed minimizing trajectories in the case of 
unbounded controls. We discuss this question in details in [11]. Another 
important issue is Proposition 17.31 on approximation of relaxed trajectories 
by ordinary ones and on estimates of the variation of the approximants; this 
result is proved in Subsection! 
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7.1. Proof of Theorem I7.lt desingularization. First we proceed with 
a " desingularizing transformation", which appeared in [I] under the name 
of 'reduction' and proved to be useful for analysis of control-affine systems 
with unconstrained controls. 

Proposition 7.1. Under Assumption \7. 1\ the following holds: 

x u (t) = e G ^ y4>u (t), V< G [0,T], u G Loo [0,21, 
where x u denotes the trajectory of the system 

±{t) = f(x(t)) + G(x{t))u{t), x(0) = x , 
y v denotes the trajectory of the system 

y(t) = (Ad(e G ^)f)(y(t)), y(0) = x Q . □ 

The substitution x = e G( ^ u ^y (sometimes called in the literature Goh 
transform) leads us to the following 'desingularized' proble nj] 

(29) y(t) = (Ad(e G ^)f)(y(t)), 

(30) J r (v) = £ (e Gv Vy(t))' P (e Gv ®y(tf) dt -► min, 
with boundary conditions 

(31) y(0)=x , y(T) = e GV x T , V G R k . 

Notice that in the case when the fields gi, i = 1,2, k are constant we 
have e Gv y = y + Gv, [Ad (e Gv ) /) (y) = f(y + Gv). Therefore, the reduced 
cost functional (|30p takes the form 

(32) J r (v) = [ y(t)'Py(t) + 2v(t)'G'Py(t) + v(t)'GfPGv(t) dt. 

Jo 

Thus, in this case the reduction procedure achieves desingularization in the 
sense that the integrand in (|32|) exhibits quadratic growth with respect to 
the new control v (provided G is full rank). This does not hold in the general 
case with nonconstant G, but it can be reasonably expected that it is a fairly 
generic outcome. However, one important feature of the nonlinear optimal 
control problem (I29p -(|30p- (|3ip is its lack of convexity with respect to v. If 
we introduce the notation 

(33) (/o(y, «),/(!/,«)) = ({e Gv y)'P{e Gv y),(Ad{e Gv )f)(y)), 
then, for generic y £ M. n (fixed) the set 

r(y) = { (y , f(y, «)) : yo > My, v), v g M m | cKxR" 

^An anonymous referee brought to our attention a publication by Yu. Orlov [17] where 
such transform has been introduced (without Lie algebraic notation) with the scope of 
passing from control problems with measure-like controls to classical control problems. 
This construction is described by the same author in |18l Ch. 4]. 
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is in general nonconvex, even in the case when G is constant. For example, 

for scalar v the set <^f(y,v),v G Rj is a curve in M. n . 

It follows that classical minimizers for the reduced problem (I29p - (l30p - 
(I3ip typically fail to exist. Instead, existence of relaxed minimizers can be 
established under the Assumptions 17.1} 17.21 17.31 and 17. 41 

7.2. Proof of Theorem I7.lt digression on relaxed controls. Recall 
that a relaxed control can be seen as a family i i — ^ 774 of probability measures 
in the space of v G such that t \— ► rjt is measurable in the weak sense 
with respect to t G [0, T\. 

Definition 7.1. Consider a nonempty set A C M. k . We denote by Ma 
the set of inner regular probability measures in M. k with compact support 
contained in A. We denote by Ma [0,T] the set of functions t \—* rjt, t G 
[0, T], where: 

i) r/ t GA4 A , Vte[0,T\; 

ii) For any continuous function, g : ^ M., the function t 1— ► 
J Rk g (t, u) r\t (du) is measurable. □ 

Let S v denote the Dirac measure in R fc concentrated at the point v. Ob- 
viously, the space of measurable essentially bounded functions can be em- 
bedded in the space A4 K fe [0,T] through the map v (t) 1— ► 5 v ( t )- 

The dynamic equation (|29p and cost functional (|30p corresponding to a 
relaxed control become 

y(t)= [ (Ad(e Gv )f)(y(t)) Vt (dv), 

JM= f T f {e Gv y(t))' P (e Gv y(t)) m (dv) dt ^ mm . 

JO JR k 

It is clear that the equations above coincide with ([29]) and (f30j) in the case 
when rjt = S v r t \ holds at almost every t € [0, T] for some function v G 

/4 [<>•'/■;• 

We use the short notation (77, /) to indicate the averaging of / by the 
measure r\. I.e., for g : R 1+k i-> M, n G Ma[0,T], (r] t ,g(t,-)) denotes the 
function 

(vt,g(t,-)) = [ g(t,u)rj t (du), t G [0,T]. 

The following proposition (see 0) relates relaxation with the convexification 
of the right-hand side. 

Proposition 7.2. Consider a C\-map X : M. k W 2 , and a nonempty set 
AcR k . Then, 

(34) {(r), X), rj G M A } = conv {X (v) , t> G A} .□ 
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Below we will consider a more restricted class of controls (called sometimes 
Gamkrelidze relaxed or chattering controls) of special form 



N N 



(35) Vt = 2^P j (t)5 vHt) , Pj (t)>0, ^ Pj (t) = l. 

3=1 3=1 

It is clear that any measurable essentially bounded control can be identified 
with such a control with N = 1. The dynamic equation and functional 
corresponding to these controls become 

N 

(36) y(t) = J>(i) (Ad (e G ^ '(')) /) (y(t)); 

3=1 

(37) JM = ^ Yj>,{t) (e^Wy(i)) P (e^Wy(t)) dt -+ mm. 

Looking at Proposition 17.21 it is easy to understand why the class of con- 
trols (|35p suffices: each vector of the convex hull in (|34p can be represented 

as a finite convex combination of (^Ad (e Gvj> j f^j (y); the same is valid for 
the functional. By virtue of Caratheodory theorem the combination need 
not have more than n + 2 summands. 

7.3. Existence of relaxed minimizers and Lipschitzian regularity 
of optimal relaxed trajectories. The existence of minimizing relaxed 
controls in the case where the set of control parameters is bounded is a well 
known result closely related to classical A.F.Filippov's existence theorem 
(see [71 Ch.8]). Our treatment involves controls without any a priori bound. 
Existence results for relaxed minimizers in this esse, circ referred to in [H Ch. 
11], but we are not aware of any previous results on Lipschitzian regularity 
of relaxed minimizing trajectories. In a separate paper [11] we present a 
technically involved proof of Lipschitzian regularity of relaxed minimizers. 
In our present setting the result in [11] takes the special form: 



Theorem 7.2. Under Assumptions 7.1, 7.S\ \7.S\ and \7.4[ the reduced prob 



n+2 

lem Ii29\) -[W \) - Ii31\) admits a minimizer, rjt = ^ Pj{t)°~vi(t)- Any such mini- 

3=1 

mizer satisfies the Pontryagin maximum principle and, provided it does not 
correspond to a strictly abnormal extremal, there exists a constant M < +oo 
such that 

(38) \(Ad(e G W)f)(y v (t))\ < M, 

(39) (e GvHt) y v (t))' P(e GvJ(t) y v (t)) < M 
hold for j = 1, 2, n + 2 and almost every t 6 [0, T]. □ 



GENERALIZED MINIMIZERS FOR CONTROL- AFFINE PROBLEMS 



27 



Remark 7.3. For generic boundary conditions the relaxed optimal trajec- 
tory corresponds to a normal extremal. Therefore, it follows from inequal- 
ity that generic optimal relaxed trajectories are Lipschitz continuous. 
Inequality fggj) together with Assumption \ 7.3\ imply that the functions v 3 , 
j = 1,2, ...,n + 2 on the corresponding Gamkrelidze control are essentially 
bounded.O 

7.4. Approximation of relaxed minimizers by absolutely-continuous 
controls. The rest of the proof of Theorem 17.11 consists of two approxima- 
tion steps. In the first step we approximate the relaxed minimizer rjt of 
the reduced problem ([29|) - ([30]) - ([3T]) by a piecewise constant control w £ (-) in 
such a way that the trajectory and the functional of (|29p . driven by w £ (-), 
are e-close to the trajectory and the functional of (|36|) . Such approximating 
controls can be chosen in such a way that the number of discontinuities is 
bounded by ^f^. 

The second step consists of approximating the piece-wise constant controls 
w £ (-) by absolutely continuous controls v £ (-), whose derivative u £ (-) = v £ (-) 
becomes e-minimizing control for the original problem (pQ)-([2])-([3]). This 
second approximants can be obtained by altering the function w £ at intervals 
of length e 2 containing the points of discontinuity. 

Using this two-step approximation we are able to prove the following 
proposition (see Subsection 19.31 below) . 

ra+2 

Proposition 7.3. Consider rjt = ^2 Pj(^)^vJ(t)> a Gamkrelidze minimizer 

i=i 

for the reduced problem (2^)-(3^)-(3lD, satisfying (3B\), (3^1 for some M < 
+oo, lety^ denote the corresponding solution to the dynamical equation L36\) . 

There exists a family of absolutely continuous piecewise linear controls v £ , 
e > such that 

i) J r (v £ ) = J r {ri) + 0[e) when e — > + ; 

ii) The trajectories of the reduced system ^29\) satisfy \\y Vs — 2/tjHx, r t] = 
0(e) when e — > + ; 

iii) The trajectories of the original system |Ij) corresponding to the con- 
trols u £ = jjjv £ satisfy x Ue (T) = xt + 0(e) when e — * + ; 

iv ) lll v «llL[o,n=°(?) ™hene^0+. □ 
The proof of Theorem 17.11 follows by noting that 

In (Const. \\u £ \\ L , QT] 

(40) a T < lim — ^ = — . 

V ; - e ^o+ ln± 

£ 

where u £ = Av e is the family of controls described in Proposition 17.31 This 

_3 



yields the estimate o~t < lim 



Const+lne ? _ 3 
ln± ~ 2- 
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8. Degree of singularity for input-commutative control-affine 
system: conjecture and example 

In the previous Section we provide an upper bound for the degree of singu- 
larity by showing how to construct a minimizing sequence with asymptotics 
a? = § ■ However we believe that this upper bound is not sharp and we 
provide the following conjecture for a sharp estimate: 



Conjecture 8.1. Under the assumptions of Theorem 7.1 

a T < 1. □ 

Our conjecture relies on the proof of Proposition 17,31 which is key frag- 
ment of the proof of Theorem l7.11 We trust that our two-step approximation 
procedure can be improved: there exists a piecewise continuous control w £ (-) 
with < (9(e _1 ) intervals of continuity, such that the end-point of the trajec- 
tory and the value of the functional of (|30p driven by w £ (-) are e 2 -close to 
the end-point of the trajectory and the value of the functional of (1371) , 

If this holds true then, by modifying this approximant in intervals of 
length e 3 instead of e 2 we obtain a family of square-integrable controls u £ = 
^ satisfying the estimate ||w e ||L 2 = 0(e~ 2 ). Then, by virtue of majoration 
(flUl) we conclude that ot < 1. 

Another possibility for sharpening the upper estimate of degree of singu- 
larity is related to the second approximation step described in the previous 
subsection. This step can be formalized as the following problem of best 
approximation . 

Problem 8.1. Let Bm = {u : ||tt||i /2 [o,T] < M} denote the ball of radius 
M in the space of square-integrable functions. Given a piecewise- continuous 
(or just essentially bounded) function ip : [0, T] M, find the asymptotics 
(the rate of decay) of the distance 

PL P (<P,B M ) = inf {\\<P ~ M\l p [o,T] : u G B m] , 

as M -> +oo (for fixed p £ N). □ 

The following example shows that, at least in some cases, the bound 
(7j> < 1 is tight. 

Example 8.1. Consider optimal control-affine problem 
x = f(x) +g 1 (x)u 1 , x = (xi,x 2 ,x 3 ), 

/ = X1 ^ + 7(X1)(X? - 1) ^' 91 = lk 



Jq = {x\ + x\ + x 2 )dt —> min, 
Jo 

x(0) = 0, x(l)=0, 



where j(x) is a smooth function supported at [—2, 2] C R, < l{x) < 1 and 
7(x) = 1 on [-3/2,3/2]. □ 
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In coordinates the dynamics of the problem is 

(41) xx=ui, x 2 = xi x 3 = j(xi)(xj - 1). 
To estimate the infimum of this problem note that 

= J 7 (xi (i)) (x! (t) 2 -lj dt< J Xi(t) 2 dt - 1, 

and hence Jq > 1. Now we construct a minimizing sequence of controls 
un(-), such that Jg(ttjv) - *• 1 as TV — > +oo. 

First take the indicator function pit) of the interval [0, 1] and construct a 
piecewise-constant function 

27V- 1 

QN(t) = Yl (" 1 )M2^-i); 

3=0 

N being a large integer. Its intervals of constancy have lengths equal to 
(27V)- 1 . 

Then, alter the function q^ on the subintervals [0,iV -3 ], 
{j(2N)- l -N- 3 ,j(2N)- 1 +N-% j = l,...,2iV-l and [l-iV" 3 ,l], trans- 
forming it into a piecewise- linear continuous function qf^(t) with boundary 
values: q c N (0) = q c N {T) = 0. 

Taking x\{t) = q c N {t) and substituting it into second and third equations 
of dH|) , we conclude that the corresponding solution satisfies the conditions 
x 2 (l) = 0, x 3 (l) = 0(N- 2 ), as N -> +oo. Besides 

f (xj + x 2 , + xl)dt-l = 0(N~ 2 ), asiV^+oo. 
J o 

The L2-norm of the corresponding control ||wi(t)||i 2 = 11^(011-^2 admits an 
estimate 

- ((iV 3 ) 2 iV" 3 iV) 1/2 = N 2 
as N — > +oo. Therefore the order of singularity satisfies <ri < 1. □ 

9. Proofs 

9.1. Proof of Proposition 14.101 In order to prove Proposition 14.10] we 
will use the following variant of Tchebyshev inequality: 

Lemma 9.1. Let u £ L 2 and A denote Lebesgue measure. Then 

2 

(42) \\u\\ L2 < i]^ Ve > : \ {x : \u(x)\ > e} < J-.D 

It suffices to prove Proposition 14.101 for distributions v = <5( m_1 ). 
Notice that for any p > m: 

j.p—m 

^tf("-i> (t) = - rr, a.e.te [0,71. 

(p — my. 
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Fix 7] > 0, and consider u G L2 [0, T] such that \\u — t] < ^ ^ 

follows from g2J that A jt G [0,T] : p u (t) - ^g^y > e} < J. Then, 
for every 9 > sufficiently small and provided 77 > is small, t 

nP — m 



?o,i G *0, *0 + , * = 1, 2, 2P" m such that 
By the mean-value theorem, there exist 

2 



lere exist 
< e. 



6i,i G 

such that 



(2i-l)0,2i0 + \ 



, i = l,2,...,2f 



-m— 1 



□p— m— 1 



(p — m — 1)! 



,p-m 
0,2i-l 



< 



2e 



7 0,2i — f0,2i-l 



Proceeding by induction we establish existence of Q p - m G 
such that 

2 P-m £ 



e, 2P~ m e + \ 



\<j> m u{9. 



p—m) 



1 < 



(»-*) 



p—m 



This implies 



(T«(0p-m) > 1 



2 p-m £ 



2 \p-m 



Once again, mean-value theorem guarantees the existence of 9 p - m +i G 
such that 



0, 2P- m 9 + ^ 



/TO— 1, 



"It ( 



It I 



7p— TO+1 ) 



J p—m ) 



> 



J p—m 



/ 



V 



2 P-m £ 



2 \ p—m 



Repeating the same argument, one proves existence of 9 V ^\ G 
such that 



0, 2P~ m 9 + 2- 



op-m 
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Applying Schwarz's inequality, we conclude 

/ 

1 - 



and 

(43) 



1 



2 \ ™—l 



2 p-m £ 



V 



If 



2 \p-m 



< 



I 



p-H 



'p-1 / „2 

u{rf dT< X /2P-™e + -L\\u\\ L2[0jT] 



e- 



\l 2 [o,t] 



> 



2P-mg + 



( 



\ 



2 p-rn £ 



2 \ p—m 



2(p — m) 



Now, for e = ^(p-mj+i , = 2 P m+1 r/ 2 (p-™)+ 1 , inequality (03]) reduces to 



Il 2 [o,t] 



> 



1 2m— 1 

"2 ^2(p-m) + l 



This proves existence of a constant C > such that 



inf {log |M| L2[0iT] : \\u - v\\ H _ p[0iT] < y} ^ 2(p 2m m) 1 +1 log ^ + log C 



log - 

for all sufficiently small r] > 0. Hence 



inf {log \\u\\ L2[0 jT] : ||u - w|| H _ p[0jr] < 77} 2m - 1 

lim — > 



log- 



2(p — m) + 1 



To prove the converse inequality, we consider piecewise polynomial func- 
tions Tp v : [0, T] 1 ^ M: 



p-i 

a * (p+i)!?; m + 1 ' 

i=0 



z/iG [0,7?]; 



(p—m)! 



ift>rj, 

and make unique choice of constants «o, ai, ctp-i £ K in such a way that 
^ becomes (p — l)-times differentiable with absolutely continuous (p— I)*' 1 
derivative. One can check that a = (ao,«i, ...,a p _i) is the unique solution 
of the linear system Ma = b, where 



/ 



M 



1 


1 


1 


1 




pi 


(P+1)! 


(P+2)I 


(2p- 


1) 


1 


1 


1 


1 




(p-1)! 


pi 


(p+l)l 


(2p- 


2) 






1 


1 




(p-2)! 


(p-1)! 


p! 


(2p- 


3) 




1 


1 


1 




1 


21 


3T 


pi 





\ 
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((p — m)\ (p — m— 1)! ^ 
It follows that a does not depend on n. 



Let u= Then, 



|2 



■ \ 2 



o 



where C±, C2 are positive constants. This shows that there exists a constant 
C such that 

inf{log||u|| L2[0 , T] :||u-«|| H _ [ 0|r] <»?} 2^-^+1 '°gj+g 

T 1 • 

log - — log - 

9.2. Degree of singularity for noncommutative driftless case (proof 
of Theorem 16. II) . In the following, we consider the cost functional 

rT 

J T ( u ) = / x'p x dt, 
Jo 

to be minimized along the trajectories of the system 

k 

(44) x = ^2 9i ( x ) u i x (°) = x o- 

»=i 

Let A X q denote the set of points x G R n which can be reached from xq 
trough trajectories of 

Assertion i) of Theorem 16.11 is obvious. Hence we only need to prove 
assertions ii) and iii). We start with assertion hi). 

Proposition 9.1. If xt £ A xo and the quadratic form x 1— * x'Px admits a 
minimum in A xo , then ot < \ . □ 

Proof. Fix x £ A XQ , such that x'Px < x'Px holds for all x £ A XQ , and 
consider the controls uq,ut £ L|[0, 1], such that: 

(1) The trajectory generated by uq starting at x(0) = xq satisfies x(l) = 

x; 

(2) The trajectory generated by ut starting at x(0) = x satisfies x(l) = 

Then, we consider the sequence of controls 

u n (t) = nu (nt) xr 0j ii (*) + nu T (I — n(T — t)) X[ T -±,t] (*) ■ 
A simple computation shows that 

x nuo(nt) (t) = x uq i n t) 
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holds for all t G [0, -] , and 

X n ur(l-n(T-t)) (*) = X UT (1 - n (T - t)) 

holds for all t G [T — — ,T]. Therefore, for all sufficiently large n G N, u n 
satisfies the boundary condition x n „ (T) = xt- Now, 

KIILm = n2 Uo" l u o ( n *)! 2 dt + Jr-i (1 — w (T — t))\ 2 dtj = 
= n2 (lo K (Ol 2 H dt + £ l^r Wl 2 £ dt ) = n (ll u o|li 2[0l i] + I|-"t||1 2[0) i] 



Also, 

J I («n) = Jo" x «o fat) di + fl~" x'Px dt+ 

n 

+ x u t (1 - n (T - t))' Px UT (1 — n (T — t)) = 

= Jo" x UQ (nt)' Px UQ (nt) - x'Px dt + j£+ 

+ It- 1 x «t (1 - n (T - t))' Px„ T (1 - n (T - t)) - x'Px dt = 

n 

— Jq n fo ~^ u o (t) P-^uq (t) x Px dt -\- — Jq x Ut (i) Px Ut (i) x Px dt — 

_ ~jT I Const. 

o —j 

where Jq = inf Jq(u). This shows that, — L 2 — < 

— v / "+^ , °" sf ■ _ By letting n go to +oo, we prove the result. □ 

Proposition 9.2. Suppose that xt G A xo and there exists x G A XQ such 
that 

(45) x'Px < max {x Pxo, x' t Pxt} ■ 
Then, o~t > |. □ 

Proof. The quadratic form x h- > x'Px admits a minimum in the closure of 
Azo- Let x G ^4a; be such a minimizer. Assumption (f45l) is equivalent to 
state that x'Px < max {x Pxo, x' t Pxt}- Without loss of generality , we 
suppose that x'Px < x'qPxq holds. Then, there exist 5 > 0, p > such that 
\x — xo| > p holds whenever x'Px < x'Px + 5 holds. Consider some fixed 
5 and p as above. For each e G ]0,<5 2 [, let u £ G L\ [0,T] denote a control 
satisfying 

(46) J T (u e ) < + e. 
This last condition implies 

/ [x' Us Px Ue — xPx) (it < £. 
Jo 
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Since x' Ue (t) Px Ue (t) > xPx holds for all t, this implies 

A {t G [0, T] : x' Ue (t) Px Ue (t) -xPx>8}< £ -. 

Here A denotes Lebesgue measure in R. It follows that there exists t £ G ] 0, | [ 
such that x' Ue (t £ ) Px Ue (t £ ) — xPx < 5. This implies that \x Ue (t £ ) — xo\ > p. 
Let 

i £ = min{i G [0, T] : \x Ue (t e ) - x \ > p] ; 
M = max 



It is clear that £ e < I and M < +oo. Therefore, we have the estimates 



P = \Xu e (te) ~ Xq\ 



8 



Iq £ E 9i (Xu e (*)) Ui 7 e (t) dt 



i=l 



< 



k 

< Jo E \9i(xu e {t))\ x \u £ (t)\ dt < 

i=l 



<Mfc\u £ (t)\ dt<Ms/T e \\u £ \\ L2[QiT] < A J^\\u £ \\ L2%TV 

pV$ Const 



This shows that 



| U £ | r „rn ti ^ 



Since u £ is an arbitrary control satisfying (|46p . it follows that 

inf {in ||n|| i2[0 T] : J T (u) < J T + e} l lne + Const 
fo| - hTi ' 

which proves the result. □ 

9.3. Proof of Proposition 17.31 We start with an auxiliary lemma, which 
establishes Lipschitz continuity of the input-to-trajectory map of system 
(|29p with respect to so called relaxation metric in the space of time- variant 
vector fields. 

Definition 9.1. Let OcM r be a nonempty open set and let J 7 be a set of 

time-variant vector fields F : [0, T] x O i— > W 1 . 

T is said to be locally uniformly Lipschitzian with respect to x if for every 
compact K C O there exists a constant m < +oo such that 



\F(t,x) -F(t,x)\ < 
holds for every F G T, t G]0, T], x, x' G K. C0 



mix' — x\ 



2 see Chapter 4] for a more general definition of uniformly Lipschitzian sets with m 
depending on t 
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Lemma 9.2. Consider a family of time-variant vector fields T , locally uni- 
formly Lipschitzian with respect to x. Fix Fq £ T and suppose that the 
solution of the differential equation 

x{t) =F {t,x(t)), x(0) = x 

(denoted by xf ) is defined for t £ [0, T\. For every F £ T we define the 
'deviation' 



F(T,x Fo (T))dT - F (r,XF Q (r))dT 



(47) A FojF = sup 

te[o,T] 

If AF (h F is sufficiently small then the solution of the differential equation 

x(t) = F (t,x (t)) , x(0)=x 
is defined for t G [0, T] and satisfies 

(48) \\x F - x Fo \\ Loo [o,T} < e mT A Fo , F , 
where m < +oo is a constant independent of F. □ 

Remark 9.1. Note the collocation of the norm beyond the integral sign in 
J^7[ ). This characterizes the so called relaxation metrics in comparison with 
integral metrics. For example Ao,f in can become small if F does not 
depend on x and is fast oscillating with respect to t (e.g. F (t,x) = cos Nt, 
with N large). □ 

Proof. Like in the standard proof of continuous dependence of solutions on 
the right-hand side of ODE's, we can assume without loss of generality 
that all fields F G T vanish outside some bounded open set containing the 
compact curve xp - Therefore, we can assume that all fields are complete 
and we only need to prove that (|48p holds. 

Let m < +oo denote the Lipschitz constant of the family T . A simple 
computation shows that 



\x F (t) - x Fo 



/ F(t,x f (t))-F (t,x Fo (t)) dr 
Jo 



< 



< 



J*F(t,x f (t))-F(t,x Fq (t)) dr 



+ 



+ 



< 



J F(t,x Fo (t)) - F (t,x Fo {t)) dr 

< to / \x f (t) - x Fo {t)\ dT + A F(h F- 
Jo 

Therefore (I48p follows by application of Gronwall inequality. 



□ 



The following Lemma is a strengthened version of the well known Gamkre- 
lidze Approximation Lemma jfy, Ch. 3]: 
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Lemma 9.3. Consider a controlled field F (-, •) : M n+fc i— > M. n , continuously 
differentiable with respect to all variables. Fix a compact set K C M. k and a 
relaxed control supported in K, n £ M.k [0, T], such that x n (the trajectory of 
the system x (t) = (F (x (t) , •) , rjt) , x (0) = xq) is defined for all t G [0, T] . 
There exists a sequence of piecewise constant controls {vn '■ [0,T] K} Nl - N , 
such that: 

i) each vn has at most (n + 2)N points of discontinuity; 

ii) \\x VN - x v \\ Loo[0tT] =0(±) as N -> oo. □ 

Proof. Since F(-,-) : M. n+k \—* R n is assumed to be continuously differen- 
tiable, it follows that the set 

{(F(.,.),ut) : ueM K [0,T}} 

is locally uniformly Lipschitzian. Therefore, due to Lemma f9.21 we only need 
to show that there exists a sequence of piecewise constant controls such that 
each vn has at most (n + 2)N points of discontinuity and A/p iVt \ f(-,v n ) = 
O (jj) as N -> oo. 

Fix N > 1, and let U = ^, i = 0, 1,2, N. Due to Proposition 
N f u 

(F (x r , (U-i) , •) , rjt) dt G conv {F {x v , v) : u G if} 



holds and the Caratheodory theorem guarantees the existence of G K, 



Pij > such that 

n+2 

E«5 - ii 

3=1 

jv= K ' w 5) = / ( F ^ (*<-i) > •) > ^) 

j=l J H— 1 

We construct the piecewise continuous control 

TV n+2 

u * (t) = EE^^i+Ejil^^A-i+E^x^^] (t) ' 

1=1 j=l 



where X[a,b] (t) denotes the characteristic function of the interval [a, b]. Now, 

N rt - 

& { F, Vt ),F(;v N ) =J2 (*) ' ^ (*)) - ( F ^ (*) ' ') ' ^» * = 

i=l ^ti-l 

= E K (*) . vn (t)) - F (x v (U-i) , v N (*))) di+ 

i=l 

+ E Ji , K (U-l) , V N (i)) - (F (X„ , •) , 7fe» dt + 

1=1 1 

N f 

+ E JJL, ((F (U-l) , •) , m) ~ (F (x„ (t) , •) , r] t )) dt. 



i=l 
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Since all fields being considered form a locally uniformly Lipschitzian set and 
x v is Lipschitzian with respect to time, there exists a constant L < +00, 
independent of N, such that 

N 



^2 [ l (F (x v (t) , v N (t)) - F {x v (ti_i) , v N (*))) dt 

i=l 

< ^2 L \x v (t) - Xr,(ti-i)\ dt< 
i=l ^*<-i 

< £ / L 2 (i — U-i) a ' ' 
i=i -^-i 



< 



holds for every sufficiently large TV. The same argument gives the similar 
inequality 

N 'U L 2 T 2 



J2 I* ((F K (U-i) , ■) , Vt) ~ (F (x v (t) , •) , Vt )) dt < 
i=i 



2iV 



Finally 

N 



/ ' (F (x v (U-i) , v N (*)) - (F (s„ («<_!) , •) , r? t )) = 
i=i ^*<-i 

AT n+2 (,. , y>j at T\ - s 

£ E f^^^F^iu-i),^) dt- 

[=1 7 = 1 ^-1^2^8=1 P»,j AT J \ / 



1=1 J 

-E/^^KCti-i),-),^) * 
1=1 

A? / _ n+2 



= E S^^^)^)-/' (F {x v (ti-i) , ■) ,rj t ) dt \ = 0, 
i=l V J=l JU - 1 J 

which proves that vn (t) has the desired property. □ 

For the second approximation step we will use the following lemma con- 
cerning approximation of piece-wise continuous controls by absolutely con- 
tinuous controls. 

Lemma 9.4. Consider a controlled field F (-, •) : M. n+k W 1 , continuously 
differentiable with respect to all variables. Fix compact sets K\ C M. n , K2 C 
R k . 

For every piecewise constant control v : [0, T] K2 with N points of 
discontinuity such that x v (the trajectory of the system x = F(x,v), x(0) = 
xo ) lies in K\ and every sufficiently small e > there exists a continuous 
piecewise linear control w £ : [0, T] conv ({0} U K2) such that: 

i) \\xw e ~ x v || Loolo.T] - CNe; 

h) \\w e \\ < 



CN 

e 



3.8 
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Here x We denotes the trajectory of the system x = F(x,v), x(0) = xq and 
C < +00 is a constant depending only on the sets K\, □ 

Proof. Fix v satisfying the assumptions of the Lemma. Let = to < t\ < 
t2 < ... < ijv = T be the points of discontinuity of v. v can be represented 
as 

N 



1=1 

Fix a small e > and let 

io = 0, v io = 0, 

{min {i :ti> t ij _ 1 + e} , if {i : U > t ij _ 1 + e} / 
N, if {i : U > t H _ x + e] = 

The piecewise linear control 



1 N 



takes values on conv ({0} U K%) and differs from v only on the union of 

N 

intervals (J [ij ■[. Since K 2 is compact, there exists a constant Cx < 
+00 such that |t> j . — t>;. 



|2 



| 2 < G\ holds for j = 1, 2, iV. Therefore, 

CxN 



£ \\L 2 [0,T] 



N I 12 
1 ij 'j — 1 I 



E 



e < 



The Lemma 19.21 guarantees that the inequality 



<e mT sup 



F(x v , w e ) - F(x v ,v) dr 







\\%We x v\\l oo \0,T] 

*£[0,T] 

holds provided the right-hand side is sufficiently small. 

Since x v lies in K±, v lies in i^2 and w e lies in conv ({0} U K2), there exists 
a constant C2 < +00 such that 
rt 

F(x v , w £ ) - F(x v , u) dr 



sup 

te[o,T] 







< 



N 



|F(z„, ty e ) - -F(x„, dr| < NC 2 £. 

j=l - "v-i 

Therefore the Lemma holds for C > max{Ci, e mT C2]- □ 

To conclude the proof of Proposition [731 we consider the augmented state 
z(t) = (J*, y(t)) with dynamics 



n+2 n+2 

(49) = J>(i)F(z(t), </(t)) = £>(*) 



i=l 



t=l 



/o(y(t),^(t)) 
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with (f , f) defined by (p3|). 

Under the assumptions of Proposition 17. 3\ there exists a compact set 
K C R k such that 

n+2 

i=i 

Let iV e = O (i) when e — > + . Due to Lemma 19.31 there exist piecewise 
constant controls {w £ : [0, T] h-> K} £>Q such that v e has O (|) points of dis- 
continuity and the corresponding trajectories of (|49p satisfy 

\\z We - ^ll Loo [ ,T] = °( £ )' Wnen 6 0+ - 

Due to Lemma I9.4| there exist continuous piecewise linear controls 
{v £ : [0, T] !-► conv ({0} U K)} s>0 such that 

\\Zv e - z Wc\\l x [0,T] = 0(e), ll*e|li 2 [0,T] = 3 )' 

when e — > + . It follows that 

|pw s — ^IIl^jo.t] — H Z-u e — Zw £ \\loo[o,T] + — ^HlooIo.t] = 0( e )- 

This shows that conditions i), ii) and iv) of Proposition 17.31 can be satisfied. 

y Vs: (T) lies e-close to Un(T), which lies in the integral manifold of G that 
contains xt- Therefore, v e can be modified (without changing the magnitude 
of the estimates above) in such a way that 

x T - e Gvs ^y Ve (T) =0(e), whene^0 + . 

This concludes the proof. 
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